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ABSTRACT 

Term Subsumption Systems (TSS) form a knowledge representation scheme in AI that can express the defining characteristics of concepts 
through a formal language that has a well-defined semantics and incorporates a reasoning mechanism that can deduce whether one concept 
subsumes another. However, TSS have very limited ability to deal with the issue of uncertainty in knowledge bases. The objective of this 
research is to address issues in combining approximate reasoning with term subsumption systems. To do this we have extended an existing 
AI architecture (CLASP), that is built on the top of a term subsumption system (LOOM), in the following ways. First, the assertional 
component of LOOM has been extended for asserting and representing uncertain propositions. Second, we have extended the pattern 
matcher of CLASP for plausible rule-based inferences. Third, an approximate reasoning model has been added to facilitate various kinds 
of approximate reasoning. And finally, the issue of inconsistency in truth values due to inheritance is addressed using justification of those 
values. This architecture enhances the reasoning capabilities of expert systems by providing support for reasoning under uncertainty using 
knowledge captured in TSS. Also, as definitional knowledge is explicit and separate from heuristic knowledge for plausible inferences, the 
maintainability of expert systems could be improved. 


1. INTRODUCTION 


Knowledge exists in a variety of forms [1], While most existing expert systems employ one or two knowledge 
representation schemes, expressing diverse knowledge in such a limited number of representation formalisms 
is difficult and time-consuming. Furthermore, it may not be possible to express completely all the knowledge 
required in an expert system. So, there is a need to integrate different knowledge representation schemes and 
to deal with the issue of incompleteness in a knowledge base. The objective of this research is to address these 
issues by combining two knowledge representation schemes, approximate reasoning and terminological reasoning. 

Approximate reasoning concerns uncertain knowledge and data in expert systems. Uncertainty in expert systems 
may arise because of incompleteness in data, unreliability of data, impreciseness of data, or even uncertain 
knowledge. For example, judgmental knowledge used in medical expert systems is uncertain in nature. Hence, 
expert systems need to handle uncertainty in such a way that the conclusions are understandable and 
interpretable by the user [10]. In approximate reasoning, fuzzy logic makes it possible to deal with different types 
of uncertainty within a single framework as it subsumes predicate logic. It is suitable for inferring from imprecise 
knowledge as all uncertainty is allowed to be expressed as a matter of degree [22]. In addition fuzzy logic 
provides suitable operators for the combination of uncertainty, including a generalized modus ponens following 
from Zadeh [22] for making inferences based on rules. 

Term Subsumption Systems (TSS), on the other hand, deal with terminological (i.e. definitional) knowledge. The 
representation scheme of term subsumption systems can express the defining characteristics of concepts through 
a formal language that has a well-defined semantics. The semantics of constructs that are often used to define 
concepts or roles are shown in Figure 1. Term subsumption systems provide a natural organization for 
terminological knowledge [3] through a structured taxonomy of conceptual entities with associated descriptions, 
which satisfy certain restrictions as well as have specific relationships to each other and where specific concepts 
can indirectly inherit characteristics from more general concepts. A guiding principle is that concepts are formal 
representational objects and that the epistemological relationships between formal objects must be kept distinct 
from the things represented by these formal objects [2]. For example the concept Rich-Person must be kept 
separate from an instance of Rich-Person. An example of terminological knowledge is shown in figure 2. In 
addition, the reasoning mechanism in these languages can deduce whether one concept subsumes another [12]. 
An automatic classifier places a concept in its proper location in a taxonomy so as to enforce network semantics 
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and consistency checking of logical subsumption relations between concepts [13]. Term subsumption systems 
originate from the ideas presented in the KL-ONE knowledge representation system, which was itself derived 
from semantic network formalisms [7], Because of the formal semantics employed, term subsumption systems 
can be viewed as a generalization of frames and semantic networks [6], [17]. 

In this work we have extended two terminological architectures for approximate reasoning; LOOM and CLASP, 
which is built on top of LOOM. This paper has partly originated from Yen and Bonissone, who have both 
addressed the issue of extending TSS for uncertainty management and outlined a generic architecture in [19], 
and has been derived from Vaidya in [16]. 


Expression e 

Interpretation [e] 

{primitive C\ 

a unique primitive concept 

: primitive R\ 

a unique primitive relation 

(:and C\ C 2 ) 

A.. [Cj] A [C 2 ] 

(:and R\ R? ) 

A xy- f-Rl] A [•Rj] 

(:at- least 1 R) 

A*. 3 y . [R](x,y) 

(texactly 1 R) 

A,. 3 y . [R](x,y) A V y ,. ([R](x,y) A [R](x,z)) -* y = z 

(tail R C) 

A,. V y . (R](x,y) - (C](y) 

({domain C) 

Ary- [C](x) 

({range C) 

Axy. [C](y) 


Figure 1. Semantics of Some Terminological Expressions 


(defconcept RICH-PERSON :is :p) 

(defconcept MILLIONAIRE :is (:and :p RICH-PERSON)) 

(defconcept BILLIONAIRE :is (:and :p MILLIONAIRE)) 

(defconcept CAR :is :p) 

(defconcept NEW-CAR :is (:and :p CAR )) 

(def relation HAS-CAR :is (:and :p (:domain PERSON) (:range CAR))) 
Figure 2. An Example of Terminological Knowledge 


2. ISSUES IN APPROXIMATE REASONING WITH TERMINOLOGICAL MODELS 

In this section we outline four issues that need to be addressed in integrating approximate reasoning with 
terminological systems. This paper will focus on the first three issues. The fourth issue has been addressed in 
[18]. 

(1) Extending the assertional component of a TSS for stating uncertain propositions : One form of uncertainty in 
TSS concerns the uncertainty about the "instance of relation. For example if there is a concept Rich-Person, a 
person may be a Rich-Person only to a certain extent. This issue concerns representing and asserting uncertain 
propositions and requires extension of the assertional component of TSS (often referred as the ABox). 

(2) Maintaining consistency of truth values associated with propositions: Another issue needs to be dealt with. This 
is related to the inheritance of concepts. The truth value of an instance in a concept may be inconsistent with 
the truth value of the same instance in another concept which subsumes the first concept or is subsumed by the 
first concept. For example, the degree of membership in the concept Millionaire can not be lower than the 
degree of membership in the concept Billionaire as a Millionaire subsumes a Billionaire. As such, a truth 
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maintenance mechanism is required to maintain consistency of truth values of the propositions. 

(3) Extending the semantic pattern matcher for partial matching: Another form of uncertainty could occur in the 
judgmental knowledge for reasoning with assertional components of term subsumption systems. For example, 
an owner of a new car may or may not be a rich person. From experts or from statistical data we may obtain 
a number to represent the likelihood that a person who owns a new car is also a rich person. This second issue 
concerns integration of such uncertainty with the uncertainty represented in the assertional component of the 
term subsumption language. For this purpose the Semantic Pattern Matcher of CLASP needs to be modified 
for performing partial matching of conditions. 

(4) Extending the semantics of terminological component of TSS for making plausible inferences : This issue 
concerns the representation of and reasoning with uncertainty in the terminological knowledge of term 
subsumption systems. 

3. INTEGRATING APPROXIMATE REASONING WITH TERMINOLOGICAL MODELS 

The architecture for integrating approximate reasoning with term subsumption systems is an extension of the 
architecture of CLASP. For incorporating approximate reasoning the architecture has extended LOOM to 
include a representation scheme for uncertain propositions, a fuzzy assertional language for asserting and 
retracting such propositions, a fuzzy truth maintenance system and an assertion processor. Moreover, the 
architecture has extended CLASP and provides for representation of uncertain rules, a fuzzy rule language, a 
modification to the semantic pattern matcher of CLASP for partial matches and an approximate reasoner which 
reasons with the uncertainty expressed in instances and rules. The architecture is represented in Figure 3. 



*-**•*» 

Figure 3. Architecture for Approximate Reasoning Using Terminological Models 


3.1 Extended Assertional Component 

3.1.1 A Fuzzy Assertional Language 

The extended assertional language includes a truth value which expresses the degree of certainty of the 
membership of an instance in the corresponding concept or role. Please refer to Figure 5 for examples of the 
assertional language. It may be noted that the f-tellm statement causes assertion of propositions, whereas the 
tforgetm statement causes retraction of propositions. 
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3.12 Internal Representation 


The internal representation has been extended to include a representation for uncertainty in instances and also 
includes a justification structure for uncertainty. This representation scheme is the basis for truth maintenance 
and reasoning in the system. An example of internal representation of an instance is given in Figure 4. 


(Instance (John) 

(fuzzy-db-type: ((Rich-Person 0.5)) 

(fuzzy-role: ((Has-Car Mercedes) 0.7)) 

(justification-for-uncertainty: 

( (RoleOrConcept: Rich-Person 
Certainty-Measure: 0.5 
Origin: Rule<New-Car-Owners-Are-Rich>) 
(RoleOrConcept: (Has-Car Mercedes) 

Certainty-Measure: 0.7 
Origin: "USER") 

) 

) 

) 

Figure 4. Example of Internal Representation of an Instance. 


32 Fuzzy Truth Maintenance System (FTMS) 

The Fuzzy Truth Maintenance System (FTMS) performs consistency checking for truth values on all assertions, 
retractions and inferences. 

32.1 Consistency Checking for Truth values of Propositions 

An fuzzy proposition in a fuzzy TSS needs to be checked for consistency because the truth value of a fuzzy 
proposition may be constrained by the truth values of other fuzzy propositions. The truth value representing the 
degree of membership of an instance in a concept needs to be compared with the truth values for the same 
instance in other concepts below or above C in the concept subsumption hierarchy. Such a comparison is based 
on the following two general principles: 

(1) The truth value of an instance in a concept C cannot be greater than the truth value of the same 
instance in any of C’s parent concepts. 

(2) The truth value of an instance in a concept C cannot be less than the truth value of the same 
instance in any of C’s children concepts. 

In summary, if q > C 7 then p c where ">" denotes the subsumption relation between concepts. 

To illustrate the above, assume concept c’, subsumes concept c 7 , which subsumes concept c' 3 - Now if an instance 
has a degree of membership a 7 ' n C,. in C 7 and ^ in c 3 then the condition a t ± z. dj must be 
satisfied. Any assertion or retraction that result in truth values that violate this condition is inconsistent. An 
example of inconsistency is shown in Figure 5. 

There are a number of sources that may cause inconsistency in truth values of data. Because inconsistencies due 
to different sources need to be handled differently we list possible sources of inconsistency below: 
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(1) Inconsistency due to deduction based on the terminological model. 

(2) Inconsistency due to an assertion or retraction by the user. 

(3) Inconsistency due to an inference made by fuzzy rules. 


Refer to terminological knowledge in Figure 2 and fuzzy-rule in Figure 7. 
Consider the following sequence of assertions: 

(f-tellm ((Has-Car John Mercedes) 0.7)) 

(f-tellm (( New-Car Mercedes) 0.5)) 

(f-tellm ((Millionaire John) 0.6)) 

The the first two assertions would cause the fuzzy-rule to fire and result in 
the inference 

((Rich-Person John) 0.5) 

However, the last assertion would cause an inconsistency as the truth value of 
John being a Billionaire (0.6) exceeds the previously inferred truth value of 
his being a Rich-Person (0.5) though Rich-Person subsumes Billionaire. 

Figure 5. Example of Inconsistency 


To deal with inconsistency, we have developed a fuzzy truth maintenance system (FTMS) that processes these 
different kinds of inconsistencies. This FTMS records the justification of propositions in a list of justification 
structures associated with each instance. A justification structure specifies (i) a fuzzy proposition and (ii) whether 
the proposition was asserted by the user, deduced by the terminological model, or inferred by a rule. For 
example, the justification structure in Figure 5 indicates that the justification that John may be a house-owner 
with a truth value of 0.5 is that a rule "Rich-People-Are-House-Owners" made such an inference. Whenever a 
new fuzzy proposition is added to by the system, the FTMS incorporates the truth value of the current 
proposition with the truth values for the same proposition in the justification list. If there is an inconsistency, then 
the user is notified, else the modification is completed. If the proposition is a binary predicate, the consistency 
checking uses the role subsumption lattice. An algorithm for truth maintenance of propositions is outlined in 
Figure 6. 

322 Assertion Processor 

The assertion processor translates user asserted statements and fuzzy rule inferences into internal assertional 
changes and propagates these changes to the deductive reasoner and the approximate reasoner. Asserted 
propositions have the highest precedence followed by propositions deduced by the deductive reasoner. 
Propositions inferred by the approximate reasoner have the lowest precedence. The deductive reasoner overrides 
the plausible inference of the approximate reasoner when a deduction is made, and when the deduced 
proposition is retracted the plausible conclusion is reactivated. 

33 Extending the Semantic Pattern Matcher for Partial Matching 

We have modified CONCRETE, the pattern matcher of CLASP, for plausible rule based inferences. 
CONCRETE is a semantic pattern matcher which uses a combination of Forgy’s Rete pattern matcher and 
LOOM’s deductive pattern matcher [20], [21]. We first outline the fuzzy rule language. Then we describe the 
deductive pattern matcher of LOOM and semantic pattern matcher (CONCRETE) of CLASP and our extension 
to semantic pattern matcher for partial match. Finally, we describe the approximate reasoner for plausible 
inferences. 
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Module Update-Fuzzy-DB(P,T) 

1. Let the fuzzy proposition, P be [ a , ^<]> where « is the argument of proposition and is the truth 
value of the proposition and T is the "type" of the fuzzy proposition, i.e., one of asserted by user, 
retracted by user, inferred by fuzzy rule or deduced by terminological model. 

2. If a fuzzy proposition P is asserted by the user then perform Consistency-Checker for the asserted truth 
value 

2. If T is either inferred by a fuzzy rule , or is deduced by the terminological model (e.g., inheritance 
links), or is retraced by the user, then 

(a) (1) if a justification structure of the proposition exists then compute the new truth value •*/ of 
the proposition else 

(2) Create a justification structure if it does not exist and assign the value of to ty. 

(b) (1) Create a fuzzy proposition Pj as [ ® , ty]. 

(2) Perform Consist en cy- Ch ecker( p.) for the resultant truth value. 

3. If Consistency-Checker( Pj returns true then 

(a) Update the justification structure as follows: If T is retraction by user remove the fuzzy 
proposition P from it else add the fuzzy proposition {P,T} to the it. 

(b) Update the proposition in the fuzzy database to P.. 

(c) Return True. 

Module Consistency-Checker(P) 

1. Let the fuzzy proposition, P be [ « , ty], where a is the argument of proposition and is the truth 
value of the proposition. 

2. Find all parent fuzzy propositions with the same argument a in the fuzzy database. 

3. Let ConsistencyCheck be the logical conjunction of the values returned by Parent-Check(P, PJ for each 
parent fuzzy proposition p = > [ « , 

4. Return ConsistencyCheck. 

Module Parent-Check(P, Pj 

1. If p subsumes P and < ty, notify the user of inconsistency. Let ReturnValue be False. 

2. If P subsumes P t and < **«, notify the user of inconsistency. Let ReturnValue be False. 

3. If neither of the above, then let ReturnValue be assigned the value returned by 
Update-Fuzzy-DB( P^deducedbyterminologicaljnodel) 

4. Return the ReturnValue. 

Figure 6. Algorithm for Truth Maintenance 
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33.1 Fuzzy Rule Language 

Uncertainty in a rule may be expressed in the consequent side of the rule which is assertional in nature. Example 
of a fuzzy rule is given in Figure 7. 


(def-fuzzy-rule New-Car-Owners-Are-Rich 
:if (:AND (NEW-CAR ?y) 

(HAS-CAR ?x ?y) ) 

:then ((RICH-PERSON ?x) 0.6) ) 

Figure 7. Example of a Fuzzy Rule 


Note that the actual truth value to be recorded for an inferred proposition as a result of the firing of the rule 
may, however, be different from the truth value of the rule as a consequence of approximate reasoning and truth 
maintenance. 

332 Semantic Pattern Matching in LOOM and CLASP 

Terminological knowledge can be viewed as a perspicuous encoding of bidirectional definitional rules. In 
classification based systems, an instance is matched to a pattern, by the realizer, by first abstracting it and then 
by classifying the abstraction [11]. A concept P is associated with a pattern P(x); thus matching an individual to 
a pattern corresponds to recognizing an instantiation relationship between the individual and the corresponding 
concept. 

The deductive pattern matcher in LOOM is an extension to the realizer [11], The classifier in LOOM’s pattern 
matcher can ask questions about the individual being classified during classification, using backward chaining, 
and a sufficiently detailed abstraction is built up incrementally. In addition the pattern matcher can also perform 
a forward inference. Thus it has mixed both forward deduction and backward deduction. 

The semantic pattern matcher in CLASP combines Forgy’s Rete Pattern Matcher with the deductive matcher 
of LOOM. The rule compiler builds a concept classification Rete (CONCRETE) net as rules are loaded into 
the rule base. The LOOM matcher computes assertional changes that can be deduced from the terminological 
knowledge and it informs the CONCRETE net about relevant changes. To avoid long chains of CONCRETE 
nodes and early unnecessary joins a data dependency analysis is performed on the patterns [20], [21]. 

3 33 Semantics-based Fuzzy Pattern Matching 

To deal with uncertainty, a fuzzy pattern matcher needs to handle tokens that express uncertainty. For this it 
needs to record the degree of match, which is the extent to which an uncertain token matches a condition of a 
rule, in appropriate nodes in the CONCRETE net. The pattern matcher also needs to combine the partial 
matches as tokens are propagated down the CONCRETE net. The fuzzy pattern matcher also needs to 
generate instantiations of fuzzy rules. In addition, as concept nodes of type TRUE do not have their own 
memory, the pattern matcher needs to query LOOM about partial class memberships. 

The pattern matcher of CLASP, CONCRETE, has been modified in three ways. 

(1) The pattern matcher has been extended to query LOOM for partial class memberships. 

(2) The instantiation structure of the CONCRETE has been extended to represent the degree of partial 
matching. 

(3) The updating mechanism for a node has been modified to calculate or update the matching degree 
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of instantiations stored in the node’s memory. 

33.4 Approximate Reasoner 

The approximate reasoner makes plausible inferences based on terminological knowledge, fuzzy propositions and 
uncertain rules. It also interacts with the FTMS to maintain consistency of the propositions database and to infer 
truth values to be used in the recording of inferred propositions. The use of justification structures in FTMS also 
helps in the combination of truth values associated with the same inference in different rules. In addition the 
approximate reasoner informs the deductive reasoner about only those additions or deletions to the propositions 
database whose certainty degree is one. Moreover, the deductive reasoner informs the approximate reasoner 
about all additions or deletions to the propositions database. 

33.4.1 Uncertainty Calculi 

The approximate reasoning model can support different kinds of approximate reasoning. The user may specify 
the model he wishes to chose. At present two models are supported. Both are based on triangular norms in fuzzy 
logic [4]. 

Uncertainty is propagated using T-norm operators in fuzzy logic. T-norms are binary functions that satisfy 
conjunction while T-conorms are binary functions that satisfy disjunction. Both are 2-place [0,1] X [0,1] to [0,1] 
functions that are monotonic, commutative and associative and their corresponding boundary conditions satisfy 
the truth tables of the logical AND and OR operators. A function T(a,b) aggregates the degree of certainty of 
two clauses in the same premise. A function S(a,b) aggregates the degree of certainty of the same conclusions 
derived from two rules. The associativity property may be used for representation of conjunction of a large 
number of clauses. 

The user may select one of the two following types of T-norm operators: 

(a) Tl(a,b) = ab and Sl(a,b) = a + b - ab 

(b) T2(a,b) = min(a,b) and S2(a,b) = max(a,b) 

33.43 Inference Mechanism 

The reasoner performs plausible inference in a data driven, forward-chaining manner. Fuzzy rules only specify 
plausible inferences which in turn update instances. As a result of firing of these fuzzy rules, the truth-value of 
an instance in a concept or in a role may be added or updated. 

A fuzzy rule, after firing once, can be instantiated again if 

(1) When one of the conditions in its pattern is no longer satisfied, or 

(2) An assertion or inference by another rule updates the truth-value of an existing proposition. 

4. RELATED WORK 

Lokendra Shastri has developed a framework, based on the principle of maximum entropy, for dealing with 
representation of and reasoning with semantic networks [14], [15]. His framework treats statements as evidential 
assertions, assigning a number to each to represent the evidential import. Given statistical data it can answer 
questions like “given the state of knowledge of an agent, which choice is most probably correct”. While his 
framework can handle exceptions, multiple inheritance and ambiguities, it has two limitations. First, his approach 
is based on the availability of statistical data which may not be available. Second, there is no classifier to maintain 
the consistency of the terminology because the concepts and roles are not of the definitional type. 

Heinsohn and Owsnicki have proposed a model of probabilistic reasoning in hybrid term subsumption systems 
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[9]. Uncertain knowledge is represented as probabilistic implications and probabilistic inheritance is used as a 
reasoning mechanism. They consider universal knowledge to be related to the extensions of concepts, i.e., the 
set of real world objects. This empirical or belief knowledge is stored in a Probabilistic Box (PBox). They have 
extended a term subsumption language by defining the syntax and semantics of probabilistic implication, which 
quantifies the relative degree of intersection of two extensions. While the range of applicability of hybrid term 
subsumption systems may be enlarged with this model, it is limited in the kind of uncertain knowledge it can 
represent. Most rules in expert systems involve complex conditions which may not be completely expressible as 
concept definitions. Therefore, probabilistic implications need to be extended before these could be used for 
building expert systems. 

Bonnisone et al. have developed a T-norm based reasoning architecture, RUM, for frame based systems [5]. The 
premise is that treatment of uncertainty must address representation, inference and control layers in expert 
systems. The representation uses a certainty frame with set of associated slots. However, the limitation of RUM 
is that it cannot use terminological knowledge, unlike term subsumption systems. 

5. SUMMARY 

An architecture has been implemented and described for approximate reasoning with terminological systems. 
The assertional component has been extended for representing and reasoning with uncertain propositions. Using 
terminological knowledge, fuzzy-rules, T-norm based uncertainty calculi and a fuzzy truth maintenance system, 
plausible inference can be made. The fuzzy truth maintenance system ensures the consistency of truth values of 
propositions and the assertion processor translates and propagates internal changes. 

This architecture presents some benefits for developing expert systems. First, expert systems can be built which 
can refer to terminological knowledge and also reason under uncertainty. Second, it allows for representation 
and reasoning using uncertainty in the assertional component as well as uncertainty in judgmental knowledge. 
These two features improve the reasoning capability of expert system. Third, terminological knowledge is applied 
to both deductive and approximate reasoning, i.e., it is reusable. And fourth, the maintainability and explanation 
capabilities of expert systems could be improved because meanings of terms are explicitly represented and are 
separated from heuristic knowledge that is used for plausible inferences. 
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